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(54) Image processing system 

(57) The present invention provides a system of 
transmitting image data from a server via a network or 
another communication path to a cellular phone or an- 
other terminal In order to enhance the picture quality of 
displayed images, the system causes input image data 
to be subjected to a tone correction process and a half- 
toning process according to display characteristics of 
the terminal. Image processing packages are provided 
in both the server and the terminal. The system selec- 
tively uses these image processing packages according 
to their processing capacities. The server determines 
execution or non-execution of image processing ac- 
cording to the type of the terminal. When any image 
processing is carried out in the server, a control signal 
representing execution of the image processing is 
mapped to the processed image data and transmitted 
to the terminal. The terminal determines requirement of 
further image processing in response to the control sig- 
nal and carries out a required series of image process- 
ing, which has not been executed by the server. In this 
system, at least either one of the server and the terminal 
takes charge of the image processing to enhance the 
picture quality. Execution of the image processing by the 
device having the higher image processing capacity ef- 
fectively improves the processing efficiency. 
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Description 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[0001 ] The present invention relates to a technique of 
controlling series of image processing carried out for im- 
age data by multiple devices connecting with a commu- 
nication path. 

Description of the Related Art 

[0002] The widefy known technique utilizes a network 
like the Internet to download image data and output im- 
ages from an image output device. Typical applications 
of the output images are displayed images on an image 
display device and printed images with a printer. Cellular 
phones that are capable of gaining access to the Inter- 
net may be used as the image display device. 
[0003] Digital image data are often subjected to di- 
verse series of image processing in the course of image 
output. The diverse image processing includes, for ex- 
ample, a halftoning process that reduces the number of 
tones expressed in each pixel, a color conversion proc- 
ess that converts the color system of master image data 
to the color system of an image output device, and a 
correction process that corrects the contrast or the tone 
of image data. Execution of the image processing ac- 
cording to the output characteristics of the device effec- 
tively enhances the picture quality of output images. 
[0004] The device having a relatively low processing 
capacity, such as the cellular phone, requires an unde- 
sirably long processing time for image processing and 
image display. One possible countermeasure simplifies 
the image processing to shorten the processing time. 
But this method does not sufficiently enhance the pic- 
ture quality of displayed images. 
[0005] A server may alternatively carry out a required 
series of image processing. But this method does not 
improve the picture quality of image data, which is trans- 
mitted from a server without the image processing ca- 
pacity. There are a diversity of image output devices and 
their applications. The uniform image processing exe- 
cuted in the server may thus not sufficiently enhance the 
picture quality. 

[0006] These problems are not restricted to the cellu- 
lar phones used as the image receiver device, but are 
common to any image receiver devices that have rela- 
tively low processing capacities and are used to output 
images. Similar problems to those arising in the course 
of image output are found in the system where the serv- 
er receives image data transmitted from an image input 
device, such as a digital camera, via the network. 

SUMMARY OF THE INVENTION 

[0007] The object of the present invention is thus to 



solve these problems and to provide a technique that 
carries out required series of image processing accord- 
ing to characteristics of an image transmitter device and 
an image receiver device in the course of inputting or 
5 outputting images via a network or another communica- 
tion path, so as to attain high-speed processing and suf- 
ficiently enhance the picture quality of resulting images. 
[0008] In order to attain at least part of the above and 
the other related objects, the present invention com- 
70 bines the functions of an image transmitter device that 
transmits image data via a communication path with the 
functions of an image receiver device that makes input 
image data undergo a required series of image process- 
ing, thus attaining the high-speed processing and suffi- 
15 ciently improving the picture quality of resulting images. 
Namely the technique of the present invention selective- 
ly uses the image processing functions of the image 
transmitter device and the image receiver device. 
[0009] In the system that downloads image data from 
20 a server connecting with the communication path and 
outputs images from an image display device or a print- 
ing device, the server functions as the image transmitter 
device, whereas the image display device or the printing 
device functions as the image receiver device. In the 
25 system that uploads image data read with a digital cam- 
era or a scanner to a server, the digital camera or the 
scanner functions as the image transmitter device, 
whereas the server functions as the image receiver de- 
vice. The server may individually constitute the image 
30 transmitter device or the image receiver device, or a plu- 
rality of servers may be combined together to take 
charge of the processing in a distributed manner. 
[0010] The selective use of the image processing 
functions of the image transmitter device and the image 
35 receiver device ensures the improvement in picture 
quality to some extent,' excluding the special case in 
which neither of the image; transmitter device and the 
image receiver device has the image processing func- 
tions. For example, the image receiver device enables 
^0 image data transmitted from an image transmitter de- 
vice without the image processing capacity to be sub- 
jected to a required series of image processing. With 
regard to a certain series of image processing executa- 
ble by both the image transmitter device and the image 
45 receiver device, the technique of the present invention 
selects either the image transmitter device or the image 
receiver device for execution of the image processing 
by taking into account the image processing capacities 
of the image transmitter device and the image receiver 
50 device and the details of the image processing. This ar- 
rangement attains the high-speed processing and fur- 
ther enhances the picture quality of resulting images. 
The construction of the present invention to actualize 
the selective use of the image processing functions is 
55 discussed below in the order of the image transmitter 
device and the image receiver device. 
[001 1 ] The image transmitter device of the present in- 
vention includes an image processing unit, a control sig- 
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nal generator, and a transmitter unit. The image 
processing unit causes input master image data to be 
subjected to a specified series of image processing. The 
details of the image processing are set according to the 
type of the image receiver device. The master image 
data may externally be input into the image transmitter 
device or may internally be stored in the image trans- 
mitter device. 

[001 2] The control signal generator generates a con- 
trol signal for controlling details of image processing to 
be executed by the image receiver device, based on the 
specified series of image processing carried out by the 
image processing unit of the image transmitter device. 
The control signal includes information used to identify 
the series of image processing executed by the image 
processing unit, if any. The control signal may follow an 
adequately selected format. 

[001 3] The transmitter unit transmits the control signal 
and the processed data to the image receiver device. 
The control signal may be attached to the processed da- 
ta for simultaneous transmission or may be separately 
transmitted like transmitting the processed data after 
transmission of the control signal. As discussed later, 
the image receiver device changes the details of the im- 
age processing executed therein in response to the con- 
trol signal. This arrangement thus ensures selective use 
of the image processing functions of the image trans- 
mitter device and the image receiver device. 
[0014] When the image transmitter device has the 
higher image processing capacity than that of the image 
receiver device, the image transmitter device carries out 
the series of image processing, which imposes a signif- 
icant load on the image receiver device, and the image 
receiver device is thus released from the image 
processing. This arrangement ensures execution of the 
image processing by the device having the higher 
processing capacity and thus shortens the processing 
time required for the image output. The image transmit- 
ter device may carry out the series of image processing, 
which is equivalent to the processing executable by the 
image receiver device or which is more complicated to 
ensure the further improvement in picture quality than 
the processing executable by the image receiver device. 
The image receiver device may take charge of the im- 
age processing, according to the image processing ca- 
pacities of the image transmitter device and the image 
receiver device. 

[0015] The image data transmitted from the image 
transmitter device without the image processing func- 
tion does not include the control signal. The image re- 
ceiver device thus readily specifies no execution of any 
image processing. In such cases, the image receiver de- 
vice carries out a required series of image processing 
to enhance the picture quality. 

[0016] It is desirable that the image data and the con- 
trol signal of the present invention follow a common for- 
mat, which is used for image data transmitted from the 
image transmitter device without the image processing 



capacity, or have upper compatibility. In one preferable 
application, a vacant bit included in a header of the im- 
age data transmitted without the image processing may 
effectively be applied for the control signal. In the case 
5 of transmitting image data in a specific language, such 
as HTML (Hyper Text Markup Language), that uses a 
tag to control the operations of the image receiver de- 
vice to some extent, the control signal may be defined 
with the tag. Transmission of the control signal accord- 
to ing to the common format used for the conventional im- 
age data enables the image receiver device to readily 
distinguish the image data transmitted from the image 
transmitter device of the present invention from the im- 
age data transmitted from another image transmitter de- 
15 vice. The technique of the present invention is, however, 
not restricted to such applications, but may adopt a 
unique format or communication protocol proper to the 
image transmitter device or the image receiver device 
of the present invention. 
20 [001 7] The technique of the present invention may be 
applied to a system, in which a server is used as the 
image transmitter device and an image output device 
that outputs images is used as the image receiver de- 
vice. In one application of this system, when the image 
25 receiver device is an image display device having a 
smaller number of expressible tones than a number of 
tones included in master image data, the image trans^ 
mitter device may carry out a dispersed-type color re- 
duction process as the specified series of image 
30 processing. 

[0018] The color reduction process reduces the 
number of tones expressed in each pixel of the master 
image data to the number of tones displayable by the 
image display device. The dispersed-type processing 
35 prevents local concentration of pixels having an identi- 
cal tone values in the processed image data after the 
color reduction. The dither method and the error diffu- 
sion method are known examples of such color reduc- 
tion. 

40 [0019] A known method of color reduction divides a 
master image into a plurality of divisions in the ascend- 
ing order of tone values, and successively allocates the 
tone values after the color reduction to the respective 
divisions. This method is hereinafter referred to as sim- 
45 pie color reduction. The simple color reduction unequiv- 
ocally maps the tone value of the master image to the 
tone value after the color reduction. The dispersed-type 
color reduction, on the other hand, does not unequivo- 
cally map the tone value of the master image to the tone 
so value after the color reduction and is thus more compli- 
cated than the simple color reduction. The dispersed- 
type color reduction, however, effectively prevents the 
occurrence of a quasi-contour after the color reduction 
and advantageously ensures the better picture quality. 
55 Application of the dispersed-type color reduction to the 
image transmitter device desirably shortens the 
processing time and enhances the picture quality. The 
arrangement of using the control signal to control the 
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image processing executed by the image receiver de- 
vice effectively prevents deterioration of the picture 
quality, due to the duplicated execution of the color re- 
duction process. 

[0020] In another application, when the image receiv- 
er device is an image display device having a non-line- 
arity of expressible tones, the image transmitter device 
may carry out a tone correction process to compensate 
for the non-linearity as the specified series of image 
processing. The non-linearity here means a non-linear 
relationship between the tone value and the actually dis- 
played brightness. There is accordingly a variation in ex- 
pressed brightness difference relative to a fixed range 
of tone values. Such non-linearity often appears in liquid 
crystal display devices, especially a liquid crystal display 
device that adopts a tone display technique called the 
frame skipping method. 

[0021] The processing that compensates for the non- 
linearity means the general processing to relieve the de- 
terioration of the picture quality due.to the non-linearity. 
The processing includes a process of correcting the 
tone value to ensure the linearity between the tone value 
and the brightness and a process of correcting the tone 
value to prevent the occurrence of a quasi-contour due 
to the non-linearity. The quasi-contour is visually con- 
spicuous, especially in a tone area having a wide bright- 
ness range relative to the width of the tone values, that 
is, in a tone area where the expressed brightness sig- 
nificantly varies with an increase of the tone value by T. 
The latter tone correction is implemented, for example, 
by reducing the distribution of the number of pixels in- 
cluded in such a tone area, that is, by converting the 
tone values included in such a tone area into a tone val- 
ue included in another tone area having a relatively nar- 
row brightness range. A tone curve representing the 
mapping of the tone values before and after the process- 
ing may be used for the tone correction. 
[0022] The above description regards the image 
processing according to the display characteristics of 
the image display device. In the case 
where a printing device is used as the image receiver 
device, the image processing may be carried out ac- 
cording to the printing characteristics of the printing de- 
vice. 

[0023] In one preferable application of the present in- 
vention, the image transmitter device receives process- 
ing characteristic information regarding image process- 
ing characteristics of the image receiver device from the 
image receiver device, and changes over the series of 
image processing executed therein according to the 
processing characteristic information. The processing 
characteristic information includes, for example, the 
type, the processing speed, and the memory capacity 
of the image receiver device. 

[0024] In the case where an image output device is 
used for the image receiver device, the image transmit- 
ter device receives output characteristic information re- 
garding image output characteristics of the image output 



device from the image output device and changes over 
the series of image processing executed therein accord- 
ing to the output characteristic information. The output 
characteristic information includes, for example, the 
5 type, the resolution, and the adopted color system of the 
image receiver device. Especially when an image dis- 
play device is used for the image receiver device, the 
output characteristic information may include the adjust- 
ed contrast value and the environmental brightness. 
10 The environmental brightness may be measured with a 
sensor attached to the image receiver device or may be 
input manually by the user. In the case of a liquid crystal 
display device, the output characteristic information 
may include the on-off state of the backlight. 
is [0025] The changeover of the details of the image 
processing according to such information ensures im- 
provement in picture quality with regard to diverse im- 
age receiver devices and under diverse working, envi- 
ronments. The changeover may be attained by chang- 
20 ing the series of image processing to be executed or by 
changing the parameters for specifying the details of the 
image processing. The former application selectively 
carries out both or either one of the tone correction proc- 
ess and the color reduction process according to the 
25 processing characteristic information or the output char- 
acteristic information. The latter application changes 
over the tone curve used for the tone correction accord- 
ing to the processing characteristic information or the 
output characteristic information. 
30 [0026] The changeover of the details of the image 
processing is readily implemented by mapping the 
processing characteristic information or the output char- 
acteristic information to the details of the image process- 
ing to be executed or the parameters and storing the 
35 mapping. The information transmitted from the image 
receiver information may include the parameters used 
for the image processing. For example, a tone curve 
used for the tone correction may be transmitted from the 
image receiver device. This arrangement advanta- 
ge geously ensures the flexible specification of the image 
processing that is adequately executed by the image re- 
ceiver device. 

[0027] The present invention is also directed to the 
image receiver device, that is in combination with the 
45 image transmitter device discussed above. 

[0028] The image receiver device of the present in- 
vention includes a receiver unit, an image processing 
unit, and a process controller. The receiver unit receives 
a series of data including image data via a communica- 
50 tion path, which may be via wire or wireless. The com- 
munication path may be a wide-area network like the 
Internet, a LAN, or a local network between the image 
transmitter device and the image receiver device. 
[0029] The image processing unit causes the input 
55 image data to be subjected to a specified series of image 
processing. The image processing includes a series of 
processing required for the image output as well as an- 
other series of processing to enhance the picture quality 
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according to the characteristics of the image rece.ver 
device. It is not required that the image processing ex- 
ecuted by the image processing unit of the image re- 
ceiver device is equivalent to the image process.ng ex- 
ecuted by the image transmitter device described 
above. The image processing executed by the image 
processing unit of the image receiver device is specified 
in an allowable range by the processing capacity of the 
image receiver device. 

[0030] The process controller controls the series of 
image processing to be executed by the image process- 
ing unit, if any, in response to a preset control signal in- 
cluded in the series of received data. The control signal 
is generated by the image transmitter device. The proc- 
ess controller determines whether or not the input image 
data has previously undergone the image processing 
and identifies the details of the image processing previ- 
ously executed, if any. In the case where no image 
processing has been carried out, the process controller 
flexibly applies a diversity of image processing execut- 
able by the image processing unit, in order to enhance 
the picture quality. In the case where some image 
processing has been carried out in advance, the proc- 
ess controller controls the image processing to be exe- 
cuted by the image processing unit, in order to prevent 
undesirable deterioration of the picture quality due to the 
interaction with the previouslyexecuted image-process- 

[0031] In the latter case, one applicable procedure 
identifies the details of the image processing previously 
executed for the input image data in response to the 
control signal, and prohibits the image processing unit 
from executing an equivalent series of image process- 
ing This arrangement effectively prevents deteriorate 
of the picture quality, due to the duplicated execution of 
the identical image processing by the image transmitter 
device and the image receiver device. 
[00321 In one application, the image receiver device 
with an image display unit having a smaller number of 
expressible tones than a number of tones included in 
the master image data carries out the dispersed-type 
color reduction process. In this application, .t is prefer- 
able that the process controller prohibits the image 
processing unit from executing color reduction, when re- 
ceiving the control signal that shows the image data has 
undergone the color reduction process. Th.s arrange- 
ment desirably prevents the same color reduction proc- 
ess from being carried out in a duplicated manner. 
[0033] In another application, the image receiver de- 
vice with an image display unit having a non-l.neanty of 
expressible tones carries out the tone correction proc- 
ess In this application, it is preferable that the process 
controller prohibits the image processing unit from exe- 
cuting an equivalent color correction process, when re- 
ceiving the control signal that shows the image data has 
undergone the color correction process. This arrange- 
ment desirably prevents the same color correction proc- 
ess from being carried out in a duplicated manner. 



[0034] The technique of the present invention is also 
applicable to a system where the image transmitter de- 
vice is connected to a plurality of image receiver devic- 
es In this application, the image transmitter device re- 
s ceives a specification of each image receiver device 
changes over the details of image processing executed 
therein according to the input specification, and trans- 
mits processed image data to the corresponding image 
receiver device. A control signal for controlling details 
io of image processing executed in each image receiver 
device is mapped to the processed image data to be 
transmitted. The specification of the image receiver de- 
vice may include at least part of the processing charac- 
teristic information and the output characteristic mfor- 
is mation discussed previously. This arrangement ensures 
the image output according to the specification of each 
image receiver device under the environment where the 
plurality of image receiver devices are connected to the 
image transmitter device. 
20 [0035] The technique of the present invention is not 
restricted to the image transmitter device or the image 
receiver device, but may be attained by a diversity of 
other applications. Such applications include a method 
of transmitting image data via the communication path 
25 to the image receiver device having the image process- 
ing functions and a method of generating image data to 
^ be transmitted. The applications also include a method* 
^ of outputting images in the image receiver device, a 
method of controlling the image receiver device, and an 
30 image processing method in the image receiver device, 
as well as a pre-processing method of image data prior 
to transmission. The present invention may also be con- 
structed as computer programs that attain these func- 
tions, a diversity of signals that are equivalent to such 
35 computer programs, and recording media in wh.ch such 
computer programs are recorded in a computer reada- 

ble manner. . 
[0036] Typical examples of the recording media in- 
clude flexible disks. CD-ROMs, magneto-optic discs IC 
40 cards, ROM cartridges, punched cards, prints with bar- 
codes or other codes printed thereon, internal storage 
devices (memories like a RAM and a ROM) and external 
storage devices of the computer, and a variety of other 
computer readable media. 
45 [0037] These and other objects, features, aspects, 
and advantages of the present invention will become 
more apparent from the following detailed descnption of 
a preferred embodiment with the accompanying draw- 
ings. 

so 



BRIEF DESCRIPTION OF THE DRAWINGS 



[0038] 



55 



Fig 1 illustrates the construction of an image trans- 
mission system including a server and a cellular 
phone in one embodiment of the present invention; 
Fig. 2 shows functional blocks of the server; 
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Fig. 3 is a table showing the selective use of the 
image processing functions of the server and the 
cellular phone; 

Fig. 4 is a flowchart showing a server-side image 
processing routine; 

Fig. 5 is a flowchart showing a terminal-side image 
processing routine; 

Fig. 6 is a flowchart showing the details of image 
processing by an API (application program inter- 
race), 

Fig. 7 shows the setting in a work area; 
Fig. 8 shows the details of a tone correction proc- 
ess; 

Fig. 9 is a flowchart showing a halftoning process 
according to the dither method; 
Fig. 10 shows the flow of processing in the dither 
method; and 

Fig. 1 1 schematically illustrates a system of upload- 
ing images. 



DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[0039] One mode of carrying out the present invention 
is discussed below in the following sequence: 

A. Construction of System 

B. Method of Selectively Using Image Processing 
Functions * 

B1. Image Processing in Server 
B2. Image Processing in Terminal 

C. Image Processing 

C1. Tone Correction Process 
C2. Halftoning Process by Dither Method 

D1. Modification (1) 
D2. Modification (2) 

A. Construction of System 

[0040] Fig. 1 illustrates the construction of an image 
transmission system in one embodiment of the present 
invention. In the image transmission system of this em- 
bodiment, a cellular phone 1 being capable of accessing 
the internet INT is used as an image receiver device 
The cellular phone 1 gains access to the Internet INT 
via radio communication with a base station CTR and 
downloads image data from a server 100 connecting 
with the Internet INT. The downloaded image data are 
processed by a control unit 10 incorporated in the eel- 
ular phone 1 , and are displayed on a liquid crystal panel 
LCD. The control unit 10 is constructed as a microcom- 
puter including a CPU and memories and carries out im- 
age processing and controls the display according to 
software programs. 



[0041] The software configuration for operations of 
the control unit 10 is also illustrated in Fig 1 An LCD 
driver 1 3 is present on the lower most layer as a software 
package for directly driving the hardware or the liquid 
* crystal panel LCD. This software package has the func- 
tion of controlling a transmission voltage applied to each 
pixel on the liquid crystal panel LCD according to image 
data. 

[0042] An image processing package 30 is provided 
on its upper layer. The image processing package 30 is 
constructed as a software package depending upon the 
.quid crystal panel LCD, and converts master image da- 
ta into a specific data format corresponding to the char- 
actenstics of the liquid crystal panel LCD. 
'5 [0043] Series of image processing include a color 
conversion process to convert the color system of the 
master .mage data into another color system applied on 
he liquid crystal panel LCD, a tone correction process 
to ad)ust the contrast and the brightness of the image 
data, and a halftoning process to reduce the number of 
tones of the mater image data into a specific number of 
tones displayable by the liquid crystal panel LCD The 
tone correction process restricts the distribution in a 
specific tone range that often causes quasi-contours 
due to characteristics of the liquid crystal panel LCD 
and shifts the distribution of the specific tone range into 
a peripheral tone range. The halftoning process does 
not carry out simple color reduction that unequivocally 
a locates color subtracted tone values to the tone values ' 
ofthe master image data, but adopts the distributed half- 
toning. These series of image processing are specified 
by taking into account the display characteristics of the 
liquid crystal panel LCD. Execution of the image 
processing effectively improves the picture quality of 
3S displayed images on the liquid crystal panel LCD 

[0044] A user interface 1 1 and a browser 1 2 that are 
present on the upper most layer utilize this imaqe 
processing package 30 to perform the series of image 
processing. The user interface 11 functions to display 
40 windows for operating the cellular phone 1 on the liquid 
crystal panel LCD. The browser 12 functions to display 
Web pages downloaded from the Internet INT Both the 
user interface 1 1 and the browser 1 2 have little depend- 
ency on the hardware and are the general purpose soft- 
ware packages having generalization to a certain ex- 
tent. An application programming interface (API) 20 is 
provided as a mediation software package that enables 
he upper-layered, general purpose software package 
to utilize the lower-layered software package having the 
» dependency on the hardware. In response to an instruc- 
tion of image processing output from the upper-layered 
software package to the API 20 according to a preset 
general purpose format, the API 20 utilizes the image 
processing package 30 to carry out the instructed image 
55 processing. a 

[0045] In the structure of this embodiment, the series 
of image processing mentioned above may be executed 
m the server 1 00. The AP1 1 20 analyzes received image 
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data and identifies the details of the pre-processing, that 
is, the series of image processing already executed. The 
API 20 adequately selects the series of image process- 
ing to be executed in the cellular phone 1 , based on the 
identified details of the pre-processing, and carries out 
only a required series of processing for display of imag- 
es having the improved picture quality. The API 20 may 
be provided as an individual software package suitable 
for the details of the image processing and the image 
processing package 30. In this embodiment, however, 
the API 20 has the general purpose basic structure and 
is usable for diverse image processing by simply chang- 
ing the specified parameters and the functions of the ap- 
plied image processing package 30. The API 20 and the 
image processing package 30 utilize a work area 40 dy- 
namically provided on the memory of the control unit 1 0 
for the processing. 

[0046] Fig. 2 shows functional blocks of the server 
100 These functional blocks are constructed as soft- 
ware packages in the server 1 00. In the structure of the 
embodiment, all the functional blocks are provided in the 
single server 1 00. These functions may, however, be ex- 
ecuted in a distributed manner by a plurality of servers. 
[0047] A communication unit 1 1 0 functions to commu- 
nicate with external devices connected via a network. 
The communication unit 1 1 0 takes charge of conversion 
between data input into and output from the server 1 00 
and specific formats corresponding to diverse protocols 
applied for communication via the network. Contents to 
be supplied from the communication unit 110 are stored 
in a specific file format like HTML in a contents storage 
unit 112. The server 100 is not restricted to the system 
that supplies internally stored contents, but may be con- 
structed as a portal system that processes externally in- 
put contents and supplies the processed contents to the 
cellular phone 1. 

[0048] An image processing unit 104 causes image 
data included in each content to undergo series of image 
processing prior to the supply, according to the require- 
ments. The series of image processing executed here 
are similar to the series of image processing executed 
in the cellular phone 1. Namely the image processing 
unit 1 04 may carry out the image processing in place of 
the cellular phone 1 , according to the requirements. The 
following description of the embodiment is on the as- 
sumption that the series of image processing executed 
by the image processing unit 104 are identical with the 
series of image processing executed by the image 
processing package 30 incorporated in the cellular 
phone 1 There may, however, be a difference in details 
of the image processing, based on the different process- 
ing capacities of the server 100 and the cellular phone 
1. The device having the poorer processing capacity 
carries out simplified image processing, which has 
slightly lower effects of improving the picture quality. The 
device having the richer processing capacity, on the oth- 
er hand, carries out complicated image processing, 
which has higher effects of improving the picture quality. 



[0049] The server 100 supplies contents to diverse 
types of cellular phones 1. The image processing unit 
104 is accordingly required to change over the details 
of the image processing according to the type of the cel- 
5 lular phone 1. A device information collector unit 108 
and an image processing parameters registration unit 
106 are provided in the server 100 to attain the change- 
over. 

[0050] The device information collector unit 108 coi- 
w lects device information regarding the cellular phone 1 
via the communication. The device information identi- 
fies the type of the cellular phone 1 and includes diverse 
pieces of information relating to display characteristics, 
such as the adjustment value of the contrast on the liquid 
is crystal panel LCD and the on-off state of a backlight of 
the liquid crystal panel LCD. Which pieces of information 
to be collected are adequately set on the system design 
by taking into account the effects on the picture quality. 
[0051] Parameters for specifying the details of the 
20 processing executed by the image processing unit 1 04 
according to the collected device information are regis- 
tered in the image processing parameters registration 
unit 106. The identification of the type of the cellular 
phone 1 specifies the resolution of the liquid crystal pan- 
25 el LCD, the number of expressible tones in each pixel, 
and the relationship between the tone value and the 
brightness. The number of tones after the color reduc-,! 
tion process and the tone curve used for the tone cor- 
rection are stored as processing parameters according 
30 to these specified pieces of information. A specific piece 
of information for specifying the details of the image 
processing to be executed by the server 100 is also 
stored by taking into account the details of the image 
processing executable by the cellular phone 1 and the 
35 processing capacity of the cellular phone 1 . For exam- 
ple, with regard to a certain type of the cellular phone 1 
that requires execution of the halftoning process by the 
server 100, a flag representing execution of the halfton- 
ing process is set in the image processing parameters' 
40 registration unit 1 06. With regard to another type of the 
cellular phone 1 that requires execution of the halftoning 
process by the cellular phone, on the other hand, a flag 
representing prohibition of the halftoning process is set 
in the image processing parameters registration unit 

45 106. 

[0052] When the image processing unit 1 04 executes 
the image processing, it is required to notify the cellular 
phone 1 of the details of the image processing. Such 
notification effectively prevents the cellular phone 1 from 
so executing the halftoning process in a duplicated manner 
after the halftoning process executed by the image 
processing unit 104. The duplicated halftoning process 
significantly damages the tone expression of a resulting 
image and undesirably lowers the picture quality of the 
55 resulting image. A control signal generator 102 func- 
tions to generate a control signal for the notification. 
[0053] The cellular phone 1 may receive contents 
from a server without the image processing unit 104 or 
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the control signal generator 1 02. The control signal gen- 
erator 102 generates the control signal, while keeping 
the upper compatibility with the image data supplied 
from such a server. The arrangement of this embodi- 
ment notes the fact that contents are generally created 
in a tagged language like HTML and defines a new tag 
for notifying the cellular phone 1 of the details of the im- 
age processing. The cellular phone 1 determines that a 
content without this tag has not yet been subjected to 
the image processing, and carries out the imaae 
processing of this content. This arrangement thus en- 
sures the upper compatibility. 

[0054] The control signal is not required to keep the 
uppercompatibility, when consideration is given to only 
the communication between the server 1 00 and the cel- 
lular phone 1 having the structures illustrated in this em- 
bodiment. In such cases, a unique control signal and a 
protocol for transmission of this unique control signal 
may be defined to attain flexible specification of the de- 
tails of the image processing. The control signal may be 
transmitted together with the image data or separately 
from the image data. J 



B. Method of Selectively Using Image Processing 
Functions 

[0055] The following describes the image processing 
process executed in this embodiment when the server 
1 00 supplies image data to the cellular phone 1 . As men- 
tioned previously, both the server 100 and the cellular 
phone 1 of the embodiment have the image processing 
capacities. A diversity of servers and cellular phones 
are, however, involved in the actual communications. 
The communication between the server and the cellular 
phone is mainly classified into the following four cases: 

Case 1 : Communication between the server 1 00 
and the cellular phone 1 of the embodiment; 
Case 2: Communication between the server 1 00 of 
the embodiment and a cellular phone with no ca- 
pacity of image processing; 
Case 3: Communication between the cellular phone 
1 of the embodiment and a server with no capacity 
of image processing; and 

Case 4: Communication between a server with no 
capacity of image processing and a cellular phone 
with no capacity of image processing. 

[0056] The case 4 corresponds to the conventional 
communications and is thus not specifically described 
here. The method of the embodiment selectively uses 
the image processing functions of the server 100 and 
the cellular phone 1 to attain the adequate image 
processing in the cases 1 to 3. 

[0057] Fig. 3 is a table showing the selective use of 
the image processing functions of the server and the cel- 
lular phone. For convenience of explanation, it is as- 
sumed that image data are subjected to two series of 



image processing 'A: tone correction process' and 'B 
halftoning process' executed in this order. 
[0058] With regard to each series of image process- 
ing, there are mainly five possible relations between the 
5 image processing capacities of the server and the cel- 
lular phone. The tone correction process is carried out 
in five possible classes; that is, a class A1 in which the 
server does not have the processing capacity, a class 
A5 in which the cellular phone or the terminal does not 
w have the processing capacity, and classes A2 to A4 in 
which both the server and the terminal have the 
processing capacities. The last classes in which both 
the server and the terminal have the processing capac- 
ities include the class A2 in which the processing capac- 
'5 ity of the server is lower than that of the terminal, the 
class A3 in which the processing capacity of the server 
is equivalent to that of the terminal, and the class A4 in 
which the processing capacity of the server is higher 
than that of the terminal. The class A1 corresponds to 
20 the case 3, the class A5 corresponds to the case 2, and 
the classes A2 to A4 correspond to the case 1 . Similar 
classification may be applied for the halftoning process. 
[0059] The table of Fig. 3 specifies the series of 
processing executed by the server and the terminal ac- 
25 cording to the image processing capacities of the server 
and the terminal. The upper left side of the slash shows 
the image processing executed by the server, whereas 
the lower right side of the slash shows the image 
processing executed by the terminal. The symbols A 
30 and B respectively represent the tone correction proc- 
ess and the halftoning process. 
[0060] For example, in the case where the server is 
not capable of either the tone correction process or the 
halftoning process (that is, in a box A1-B1), the server 
35 does not carry out any image processing, and the ter- 
minal carries out both the tone correction process and 
the halftoning process. Such settings are also adopted 
in a range where the processing capacity of the server 
is lower than the processing capacity of the terminal 
™ (that is, in boxes A1-B2, A2-B1 , and A2-B2). This is be- 
cause execution of the processing on the side having 
the higher processing capacity effectively shortens the 
processing time. 

[0061 ] In the technique of this embodiment, the termi- 
45 nal also executes both the tone correction process and 
the halftoning process in a range where the processing 
capacity of the server is equivalent to the processing ca- 
pacity of the terminal (that is, in boxes A1-B3, A2-B3 
A3-B1 , A3-B2, and A3-B3). There is a possibility that the 
50 processing is concentrated on the server that commu- 
nicates with a number of terminals. Execution of the 
processing by the terminal thus ensures the higher- 
speed processing. 

[0062] In a range where the processing capacity of the 
55 server is higher than the processing capacity of the ter- 
minal with regard to only the tone correction process 
(that is, in boxes A4-B1 to A4-B3 and A5-B1 to A5-B3) 
the server executes the tone correction process, while 
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the terminal carries out the halftoning process. In a 
range where the processing capacity of the server is 
higher than the processing capacity of the terminal with 
regard to only the halftoning process (that is, in boxes 
A1-B4 to A3-B4), the terminal carries out both the tone 
correction process and the halftoning process. The tone 
correction process and the halftoning process are car- 
ried out in this order. The server executing the halftoning 
process is thus required to also carry out the tone cor- 
rection process. It is, however, not desirable that the 
server having the lower processing capacity carries out 
the tone correction process. 

[0063] In a range where the processing capacity of the 
server is higher than the processing capacity of the ter- 
minal with regard to both the tone correction process 
and the halftoning process (that is, in boxes A4-B4, 
A5-B4, A4-B5, and A5-B5), the server carries out all the 
processing. 

[0064] In the above manner, the technique of the em- 
bodiment changes the details of the image processing 
carried out by the server and the terminal according to 
the processing capacities of the server and the terminal. 
The table of Fig. 3 shows the selections to shorten the 
processing time based on only the processing capaci- 
ties with regard to the two series of processing. The sim- 
ilar classification policy may be applied for the three or 
more series of processing. In the case where the quan- 
tity of data is varied before and after the image process- 
ing the time required for communication may be taken 
into account for the selection. The selection is attained 
by a control operation discussed below. 

B1. Image Processing by Server 



[0065] Fig. 4 is a flowchart showing a server-side im- 
age processing routine, which is mainly executed by the 
image processing unit 104 incorporated in the server 
100 The process enters this routine when the cellular 
phone 1 gains access to the server 100 and gives an 
instruction to download a content including image data. 
[0066] The server 1 00 first collects device information 
regarding a terminal that communicates with the server 
100 at step S10. Here the device information identifies 
the type of the terminal. Identification of the type of the 
terminal specifies the processing capacity of the termi- 
nal that is, determines whether or not an image 
processing package is provided in the terminal. At sub- 
sequent step S1 2, the server 1 00 sets a series of image 
processing to be executed by the server 100 according 
to the criteria shown in the table of Fig. 3, based on the 
result of the specification. In this embodiment, the image 
processing unit 104 refers to the table of Fig. 3 stored 
in the image processing parameters registration unit 
106 to specify the details of the image processing. 
[0067] The server 100 then actually carries out the 
specified series of image processing at step S14. The 
series of image processing includes the tone correction 
process and the halftoning process, which will be dis- 



cussed later. 

[0068] The server 1 00 subsequently generates a con- 
trol signal according to the executed series of image 
processing at step S16. The control signal is used to 

5 notify the terminal of the details of the image processing 
executed by the server 100. As mentioned previously, 
the technique of the embodiment uses a tag uniquely 
defined as the control signal. The tag specifies the de- 
tails of the processing, that is, execution of both the tone 

10 correction process and the halftoning process, execu- 
tion of only the tone correction process, or no execution 
of either processes. 

[0069] The server 1 00 maps the tag generated at step 
S16 to the result of the image processing obtained at 
is step S1 4 and transmits the mapping to the terminal at 
step S18. The tag may be mapped to the result of the 
image processing, for example, by inserting the tag im- 
mediately before another tag that identifies image data 
as the object of image processing in an HTML file. 

20 

B2. Image Processing by Terminal 

[0070] Fig. 5 is a flowchart showing a terminal-side 
image processing routine. The terminal receives data 
25 sent from the server at step S20 and specifies a series 
of image processing to be executed by the terminal, 
based on the control signal at step S22. In the case^ 
where the server 100 has carried out some image 
processing, the received data includes the tag as the 
30 control signal. The terminal analyzes this tag to identify 
the series of image processing executed by the server 
1 00 and specif ies the series of processing to be execut- 
ed by the terminal. In the example of Fig. 3, when the 
server 1 00 has carried out only the tone correction proc- 
35 ess, the tag prohibits execution of the tone correction 
process by the terminal and requires the terminal to ex- 
ecute only the halftoning process. When the server 100 
has carried out both the tone correction process and the - 
halftoning process, the tag prohibits execution of any im-* 
40 age processing by the terminal. 

[0071 ] The data received from a server other than the 
server 1 00 of the embodiment, that is, from a server hav- 
ing no image processing capacity, does not include the 
tag as the control signal. In such cases, the terminal de- 
45 termines that no series of image processing has yet 
been carried out. The terminal accordingly carries out 
both the tone correction process and the halftoning 
process. 

[0072] After specifying the series of image processing 
so to be executed by the terminal based on the execution 
or non-execution of the processing by the server, the 
terminal actually carries out the specified series of im- 
age processing at step S24 and displays a resulting 
processed image at step S26. The procedure of image 
55 processing will be discussed later. 
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C. Image Processing 



[0073] The image processing carried out in this em- 
bodiment is discussed below. The server and the termi- 
nal follow the same procedure for the image processing. 
The following description accordingly regards the com- 
mon procedure to the server and the terminal, although 
the technique of the embodiment is not restricted to the 
identical image processing routine executed by both the 
server and the terminal. Different image processing rou- 
tines may be adopted according to the structures of the 
server and the terminal. The details of the tone correc- 
tion process or the halftoning process executed by the 
server may differ from those by the terminal. 
[0074] Fig. 6 is a flowchart showing the details of the 
image processing by the API (application program inter- 
face) 20. In this embodiment, the API is provided as the 
general purpose image processing routine, and the im- 
age processing package used by the API is changed to 
implement diverse image processing. The CPU in the 
server or the terminal executes this image processing 
routine in response to an instruction to,execute the im- 
age processing. 

[0075] The CPU first inputs processing conditions, for 
example, the size of image data, the type of image 
processing to be executed, and the unit of processing 
at step S110, and sets and initializes the work area 40 
required for the processing according to the input 
processing conditions at step S112. Fig. 7 shows the 
setting in the work area 40. Each square in Fig. 7 rep- 
resents a unit of storage mapped to each address on 
the memory space. The work area 40 is mainly divided 
into three areas; a parameters storage area A1 to store 
the processing conditions therein, an image data input 
area A2 to store therein image data before the process- 
ing, and a results output area A3 from which the results 
of processing are output. The respective areas A1, A2, 
and A3 are specified by pointers P1 , P2, and P3. 
[0076] The CPU continues inputting image data into 
the image data input area A2 by the unit of a raster line 
at step S1 20 until the input of all the image data is com- 
pleted at step S114. The procedure of this embodiment 
uses output line data OEL to determine whether or not 
a required quantity of data have been input for the image 
processing. In the case of image processing that utilizes 
only the tone values of individual pixels, such as the tone 
correction process, the number of input raster lines is 
output as the output line data OEL. In the case of image 
processing that utilizes the tone values of plural pixels 
over multiple raster lines for processing of each pixel, 
such as the error diffusion method, on the other hand' 
the output line data OEL takes a value of not lower than 
1 at the time when data of at least 2 raster lines are input. 
[0077] The CPU determines that the image process- 
ing is executable in the case of the output line data OEL 
> 0 at step S130, and calls the image processing pack- 
age corresponding to the specified series of image 
processing to actually execute the specified series of im- 



age processing at step S1 40. On completion of the im- 
age processing at step S1 40, the CPU deletes the proc- 
essed image data and updates the output line data OEL 
When it is determined at step S114 that the input and 
5 processing of all the image data is concluded, the CPU 
displays a resulting processed image at step S200. The 
program then exits from this image processing routine. 



w 



C1. Tone Correction Process 



[0078] The following successively describes the de- 
tails of the tone correction process and the halftoning 
process executed as the image processing of step 
S140. Fig. 8 shows the details of the tone correction 
*s process. The left half of the drawing shows data stored 
in the areas A2 and A3 of the work area 40. In the re- 
spective storage areas, each line of data expressed as 
R21 or R22 corresponds to data of one raster line in an 
image. Each hatched part represents an area in which 
20 data are stored. 

[0079] In this embodiment, the tone correction proc- 
ess is carried out when the quantity of image data input 
by the unit of a pixel reaches data of 1 raster line (that 
is, at the time of a shift from the upper most row R21 to 
25 the intermediate row R22 in the drawing). The CPU 
reads a tone value TN of one pixel from the image data 
input area A2 at step S1 41 , calculates a corrected tone 
value TNC according to a function f(TN) at step S142, 
and outputs the corrected tone value TNC of one pixel 
3 o to the output area A3 at step S1 43. 

[0080] A diversity of settings may be applied for the 
function f(TN) according to the details of the tone cor- 
rection process. For example, to enhance the contrast, 
the following equation is used as the function f(TN): 

TNC = a-TN + b 



where a and b are real number parameters for regulating 
*o the degree of enhancement of the contrast. 

[0081 ] The function f (TN) is not restricted to the math- 
ematical expression but may be a tone curve specifying 
the relationship between the input tone value TN and 
the corrected tone value TNC as shown in Fig. 8. 
45 [0082] The illustrated tone curve corrects an input 
tone value TN1 to a smaller tone value TNC1. In the 
case where the display characteristics of the terminal 
tend to cause a quasi-contour in the vicinity of the tone 
value TN1, application of this tone curve restricts the 
so distribution of the tone value TN1 , thus making the qua- 
si-contour sufficiently inconspicuous. Adjusting the real 
number parameters or the setting of the tone curve ef- 
fectively improves the picture quality of resulting proc- 
essed images according to the display characteristics 
55 of the terminal. 

[0083] In this embodiment, an image processing 
package using the real number parameters or the tone 
curve set according to the display characteristics is pro- 
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vided in the cellular phone 1 . The tone curve or the real 
number parameters corresponding to the type of the cel- 
lular phone are stored in the image processing param- 
eters registration unit 106 of the server 100. The server 
1 00 carries out the tone correction process according to 
the type of the cellular phone 1 , based on these values 
stored in the image processing parameters storage unit 
106. 

[0084] The CPU repeats the above series of process- 
ing with regard to each pixel until the processing of one 
raster line is completed at step S144. The CPU then de- 
letes the non-required data of the raster line R21 stored 
in the image data input area A2 at step S1 45. The lower 
most drawing on the left side of Fig. 8 shows the state 
after the non-required data is deleted. 

C2. Halftoning Process according to Dither Method 



[0085] The halftoning process is color reduction car- 
ried out when the number of expressible tones in each 
pixel on the liquid crystal panel LCD is smaller than the 
number of tones included in master image data. The 
dither method uses a threshold value matrix called a 
dither matrix for the halftoning process and expresses 
multiple tones based on a distribution of pixels having 
respective tone values. The following description is on 
the assumption that a master image of 256 tones is sub- 
jected to color reduction to 5 tones. 
[0086] Fig. 9 is a flowchart showing the halftoning 
process according to the dither method. Fig. 10 shows 
the flow of processing in the dither method. When the 
program enters the halftoning process according to the 
dither method, the CPU first reads tone data CD of one 
pixel from the image data input area A2 at step S150, 
and subsequently identifies a tone division number N 
according to the value of the input image data CD and 
specifies a lower limit value LL and an upper limit value 
UL of the identified tone division at step S1 51 . 
[0087] Tone divisions are shown in the middle of Fig. 
10. The procedure of this embodiment carries out color 
reduction to 5 tones, so that the tone range of the master 
image (the tone values of 0 to 255) is divided into four 
equal portions expressed as tone divisions 0 to 3. The 
tone division number N is assigned to each tone division 
in the ascending order of the tone values for the purpose 
of identification. As shown in Fig. 10, the tone division 
0 includes tone values 0 to 63, the tone division 1 in- 
cludes 64 to 1 27, the tone division 2 includes 1 28 to 1 91 , 
and the tone division 3 includes 192 to 255. For exam- 
ple, when the input image data CD has a tone value 28, 
which is included in the tone division 0, the identified 
tone division number N is equal to 0. In this case, the 
lower limit value LL and the upper limit value UL of the 
identified tone division are respectively equal to 0 and 
63. 

[0088] The CPU subsequently sets a threshold value 
TH in a range corresponding to the specified tone divi- 
sion at step S152. The dither method extracts a thresh- 



old value THM from a preset dither matrix. Part of the 
dither matrix is illustrated in the upper portion of Fig. 1 0. 
In this embodiment, a 4x4 matrix is applied for the dither 
matrix. The dither matrix has threshold values, which 

s are selected out of the range of 0 to 255 in an unbiased 
manner, as its entries. The halftoning process uses a 
threshold value stored at a position corresponding to 
each pixel of interest in the dither matrix. In the example 
of Fig. 1 0, the upper left threshold value 1 00 in the dither 

io matrix is used to process the upper left pixel of the image 
data CD (the tone value 28). 

[0089] The halftoning process is carried out on the ba- 
sis of the tone division. It is accordingly required to cor- 
rect the threshold value THM extracted from the dither 
15 matrix in the range of 0 to 255 to a threshold value TH 
in a range corresponding to the specified tone division. 
The process of step S152 implements such correction 
and calculates the corrected threshold value TH from 
the threshold value THM extracted from the dither matrix 
20 according to the following equation: 



TH = f HM(UL-LL) / 255 + LL 

25 As shown in Fig. 10, mapping of the threshold value 
THM = 1 00 to the tone division 0 according to the above 
equation gives the threshold value TH = 25. *** 
[0090] The CPU compares the calculated threshold ' 
value TH with the tone value CD of the input image data 
30 at step S1 53. When the input tone value CD is not great- 
er than the threshold value TH, a value N is set to a 
resulting value RV at step S154. When the input tone 
value CD is greater than the threshold value TH, on the 
other hand, a value (N+1) is set to the resulting value 
35 RV at step S155. In the example of Fig. 10, since the 
input tone value 28 is greater than the calculated thresh- 
old value 25, a value ' V (= the tone division number N=0 
+ 1 ) is set to the resulting value RV. This resulting value,- 
RV represents the tone value after the color reduction - 
40 In the tone division 0, the tone value after the color re- 
duction is set either equal to 0 or 1 , based on the com- 
parison between the input tone value CD and the calcu- 
lated threshold value TH. In a similar manner, the tone 
value after the color reduction is set equal to either 1 or 
45 2 in the tone division 1 , either 2 or 3 in the tone division 
2, and either 3 or 4 in the tone division 3. 
[0091] The CPU repeats above series of processing 
until the output of one raster line is concluded at step 
S156. On completion of the processing, the CPU de- 
so letes non-required data and updates the output line data 
OEL. The program then exits from the halftoning proc- 
ess routine. Although the above description regards the 
color reduction to 5 tones, the same processing flow is 
applicable to any number of tones. 
55 [0092] The number of tones after the color reduction 
depends upon the number of expressible tones by the 
liquid crystal panel LCD. In this embodiment, the image 
processing package provided in the cellular phone 1 at- 
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tains color reduction to a specific number of tones cor- 
responding to its display characteristics. The number of 
tones after the color reduction specified according to the 
type of the cellular phone 1 is registered in the image 
processing parameters registration unit 1 06 of the serv- 
er 100. The server 100 executes the halftoning process 
according to the type of the cellular phone 1 , based on 
this value registered in the image processing parame- 
ters registration unit 106. 

[0093] The image processing is not restricted to the 
halftoning process according to the dither method. The 
image processing may be any of other diverse tech- 
niques, for example, the process of converting the color 
system or the halftoning process according to the error 
diffusion method, to enhance the picture quality of im- 
ages displayed in the cellular phone 1. Different tech- 
niques may be applied for the processing by the server 
100 and that by the cellular phone 1. For example, the 
server 1 00 carries out the halftoning process according 
to the error diffusion method that attains the better pic- 
ture quality, whereas the cellular phone 1 carries out the 
halftoning process according to the dither method that 
ensures the lighter load of processing. 
[0094] The image transmission system of this embod- 
iment discussed above selectively uses the image 
processing functions of the server 100 and the cellular 
phone 1. The server 100 does not uniformly carry out 
the image processing, but changes over the series of 
image processing according to the processing capacity 
and the display characteristics of the cellular phone 1 
functioning as the image transmitter device. In the case 
where the image transmitter device is the cellular phone 
without the image processing capacity to enhance the 
picture quality, the server 100 carries out the required 
series of image processing to enhance the picture qual- 
ity. In the case of the cellular phone having the lower 
image processing capacity, the server 100 also carries 
out the required series of image processing to shorten 
the processing time. When the image processing capac- 
ity of the server 1 00 is sufficiently higher than the image 
processing capacity of the cellular phone 1 , the server 
100 ensures execution of the more advanced process- 
ing than the processing by the cellular phone 1, so as 
to enable further enhancement of the picture quality. 
The server 100 changes over the details of the image 
processing according to the device information regard- 
ing the cellular phone 1, thus attaining the effective 
processing adequate for the display characteristics of 
the cellular phone 1. 

[0095] The cellular phone 1 also adequately changes 
over the series of image processing according to the in- 
put image data. Decoding the control signal prevents the 
image data, which have already undergone the image 
processing in the server 100, from being processed by 
the cellular phone 1 in a duplicated manner. Namely the 
server 100 maps the control signal to the image data, 
thereby controlling the image processing executed by 
the cellular phone 1. Such control effectively prevents 



identical image data from being subjected to image 
processing in a duplicated manner, thus enhancing the 
picture quality. 

[0096] When receiving non-processed image data, 
5 which have not undergone the image processing in the 
server 1 00, the cellular phone 1 carries out the required 
series of image processing to enhance the picture qual- 
ity. Namely the object of the processing by the cellular 
phone 1 is data transmitted from the server 100 of the 
10 embodiment without the image processing and data 
transmitted from a conventional server without the im- 
age processing capacity. The cellular phone 1 changes 
over the series of image processing executed therein, 
based on the control signal. This arrangement ensures 
15 the effects of improving the picture quality to some ex- 
tent with regard to image data transmitted from any serv- 
er. 
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D1. Modification (1) 



[0097] The above embodiment may be modified in 
various ways. In the embodiment discussed above, the 
series of image processing executed by the server 100 
is changed according to the type of the cellular phone 
2 5 1 . The image processing may be changed more minute- 
ly. Even in an identical type of the cellular phone 1 , the 
display characteristics of the liquid crystal panel are var- 
ied by the environmental brightness and the on-off state 
of the backlight. One modified arrangement thus makes 
30 the device information collector unit 108 receive such 
pieces of information affecting the display characteris- 
tics and change the image processing parameters 
based on the input information. The environmental 
brightness may be measured with a sensor attached to 
35 the cellular phone 1 or input by the user. The liquid crys- 
tal panel having the contrast adjustment function may 
change the image processing parameters according to 
the contrast adjustment value. 

[0098] In order to facilitate the change of the param- 
40 eters, the parameters corresponding to not only the var- 
ious types of the cellular phone 1 but the diverse pieces 
of device information mentioned above may be stored 
in the image processing parameters registration unit 
1 06. For example, a plurality of tone curves used for the 
45 tone correction may be provided according to the vari- 
ous types of the cellular phone 1 and multiple contrast 
adjustment values. Another application corrects the 
tone curve provided for each type of the cellular phone 
1 according to the contrast adjustment value. 
50 [0099] In the above embodiment, the parameters for 
specifying the details of the image processing with re- 
gard to each type of the cellular phone 1 are stored in 
the image processing parameters registration unit 106 
of the server 100. These parameters may alternatively 
55 be received from the cellular phone 1 as device infor- 
mation. For example, the tone curve may be received 
from the cellular phone 1 and used for the tone correc- 
tion. In this arrangement, each server is not required to 
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store the information regarding all the types of the cel- 
lular phone 1 . This effectively relieves the maintenance 
loading of the server in response to each increase in 
number of the types of the cellular phone 1. This ar- 
rangement also enables the cellular phone 1 to readily 
reflect the modification of the tone curve on the image 
processing executed by the server. 
[01 00] In the embodiment, the cellular phone 1 is used 
as the terminal. A diversity of other devices connectable 
with the network may be applied for the image output 
terminal. For example, the liquid crystal display, the gen- 
eral purpose computer, or the printer may be the termi- 
nal The terminal having the image processing function 
and the function of controlling the details of the image 
processing in response to the control signal ensures 
construction of a system similar to the system of the em- 
bodiment. The series of image processing to be execut- 
ed may adequately be selected according to the type of 
the terminal. 

D2. Modification (2) 



[0101] In the embodiment discussed above, the cel- 
lular phone 1 functioning as an image output device 
downloads image data from the server 100. The tech- 
nique of the present invention may be applied to a sys- 
tem of uploading images to the server 1 00. In this appli- 
cation, a scanner or a digital camera connectable with 
the network takes in an image, carries out a required 
series of image processing to process the input image, 
and transmits the processed image to the server. In this 
application, the scanner or the digital camera corre- 
sponds to the image transmitter device, and the server 
corresponds to the image receiver device. 
[0102] Fig. 11 schematically illustrates a system of up- 
loading images. In this example, a scanner 3 is used as 
an image input device. The scanner 3 has the function 
of transmitting data via a network and uploads images 
to a server 100A via the Internet INT. 
[0103] The server 100A has the same structure as 
that of the server 100 shown in Fig. 2. The scanner 3 
has functional blocks of a server information collector 
unit 201 , a scan controller 202, an image processing unit 
203, and a control signal generator 204. The scan con- 
troller 202 implements the proper functions of the scan- 
ner 3. . . 
[0104] The server information controller unit 201 in- 
cluded in the scanner 3 collects device information re- 
garding the server 100A, which functions as the desti- 
nation of transmitted image data. This corresponds to 
the function of the server 1 00 to collect the device infor- 
mation regarding the cellular phone 1 in the above em- 
bodiment. The device information includes the image 
processing capacity of the server 100A. 
[0105] The image processing unit 203 causes input 
image data to undergo various series of image process- 
ing The image processing includes color correction of 
the input image data and adjustment of the contrast. In 



the same manner as the embodiment, the procedure 
specifies the series of image processing to be executed 
by the scanner 3, based on the device information on 
the server 100A. 
s [01 06] The control signal generator 204 generates a 
control signal, which is used to transmit the result of the 
image processing executed in the scanner 3 to the serv- 
er 100A. The image processing unit incorporated in the 
server 1 00A identifies the details of the image process- 
to ing executed by the scanner 3 based on the control sig- 
nal and carries out a required series of image process- 
ing, which has not been executed by the scanner 3. The 
server 1 00A changes over the series of image process- 
ing based on the device information of the scanner 3 in 
15 the same manner as the embodiment. This application 
also selectively uses the image processing functions of 
the image input device and the server, thus attaining the 
effects similar to those of the embodiment. 
[0107] The above embodiment and its modifications 
20 are to be considered in all aspects as illustrative and not 
restrictive. There may be many modifications, changes, 
and alterations without departing from the scope or spirit 
of the main characteristics of the present invention. For 
example, the diverse control processes discussed 
25 above may be attained by the hardware structure, in- 
stead of the software configuration . 
[0108] The scope and spirit of the present invention^ 
are indicated by the appended claims, rather than by the 
foregoing description. 
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Claims 

1 An image transmitter device that transmits image 
35 data via a communication path to an image receiver 
device connecting with the communication path and 
having an image processing function, 

said image transmitter device comprising: 

40 an image processing unit that generates proc- 

essed data from input master image data by a 
specified series of image processing; 
a control signal generator that generates a con- 
trol signal for controlling details of image 

45 processing to be executed by said image re- 

ceiver device based on the specified series of 
image processing carried out by said image 
processing unit; and 

a transmitter unit that transmits said processed 
so data and said control signal to said image re- 

ceiver device. 

2 An image transmitter device in accordance with 
claim 1, wherein said image receiver device is an 
55 image output device for outputting images. 

3. An image transmitter device in accordance with 
claim 2, wherein said image output device is an im- 



13 



25 



EP 1 191 783 A2 



26 



7. 



age display device having a smaller number of ex- 
pressible tones than a number of tones included in 
master image data, and 

the specified series of image processing is a 
dispersed-type color reduction process. 

■« An image transmitter device in accordance with 
claim 2, wherein said image output device is an im- 
age display device having a non-linearity of ex- 
pressible tones, and 

said image processing unit carries out a tone 
correction process to compensate for the non-line- 
arity. 

An image transmitter device in accordance with 
claim 1 , said image transmitter device further com- 
prising: 

a processing characteristics receiver unit that 
receives processing characteristic information, 
which regards image processing characteris- 
tics of said image receiver device, from said im- 
age receiver device, 

wherein said image processing unit specifies 
the series of image processing to be executed 
therein according to the processing characteristic 
information and executes the specified series of im- 
age processing. 

An image transmitter device in accordance with 
claim 2, said image transmitter device further com- 
prising: 

an output characteristics receiver unit that re- 
ceives output characteristic information, which 
regards image output characteristics of said im- 
age output device, from said image output de- 
vice, 
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a process controller that identifies details of 
pre-processing that has previously been exe- 
cuted for the image data, if any, in response to 
a preset control signal included in the series of 
received data, and controls the specified series 
of image processing to be executed by said im- 
age processing unit, if any, based on a result of 
the identification. 

An image receiver device in accordance with claim 
8, wherein said process controller prohibits said im- 
age processing unit from executing a certain series 
of image processing that is equivalent to the pre- 
processing. 



10. An image receiver device in accordance with claim 
8, said image receiver device further comprising: 

an image display unit having a smaller number 
of expressible tones than a number of tones in- 
cluded in master image data; and 
a driving unit that drives said image display unit, 

wherein the specified series of image 
processing is a dispersed-type color reduction proc- 
ess, and 

said process controller prohibits said image 
processing unit from executing the color reduction 
process when the input control signal shows that 
the image data has already undergone color reduc- 
tion. 
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wherein said image processing unit specifies 
the series of image processing to be executed 
therein according to the output characteristic infor- 
mation and executes the specified series of image 
processing. 

An image transmitter device in accordance with 
claim 6, wherein the output characteristic informa- 
tion includes a parameter used for the specified se- 
ries of image processing. 



8. An image receiver device, comprising: 

a receiver unit that receives a series of data in- 
cluding image data via a communication path; 
an image processing unit that causes the input 
image data to be subjected to a specified series 
of image processing; and 
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An image receiver device in accordance with claim 
8, said image receiver device further comprising: 

an image display unit having a non-linearity of 
expressible tones; and 

a driving unit that drives said image display unit, 

wherein the specified series of image 
processing is a tone correction process for compen- 
sating the non-linearity, and 

said process controller prohibits said image 
processing unit from executing the tone correction 
process when the input control signal shows that 
the image data has already undergone an equiva- 
lent tone correction. 

An image transmitter device that transmits image 
data via a communication path to a plurality of im- 
age receiver devices connecting with the commu- 
nication path, 

said image transmitter device comprising: 

a specification receiver unit that receives a 
specification of each image receiver device 
from said each image receiver device; 
an image processing unit that specifies a series 
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of image processing to be executed therein ac- 
cording to the input specification, and gener- 
ates processed data from input master image 
data by the specified series of image process- 
ing; 

a control signal generator that generates a con- 
trol signal for controlling details of image 
processing to be executed by said each image 
receiver device based on the specified series 
of image processing carried out by said image 
processing unit; and 

a transmitter unit that transmits said processed 
data and said control signal to said each image 
receiver device. 

13. A method of transmitting image data via a commu- 
nication path to an image receiver device connect- 
ing with the communication path, said method com- 
prising the step of: 

when master image data has been subjected 
to a specified series of image processing, trans- 
mitting a control signal for controlling details of 
image processing to be executed by said image 
receiver device based on the specified series 
of image processing, in relation with processed 
data obtained as a result of the image process- 
ing. 

14. An image processing method in an image receiver 
device, said image processing method comprising 
the steps of: 

(a) determining requirement of image process- 
ing and, when required, specifying a series of 
image processing to be executed by said image 
receiver device, in response to a control signal 
mapped to image data received via a commu- 
nication path; and 

(b) making the input image data subjected to 
the specified series of image processing based 
on a result of the determination in said step (a), 
and outputting a resulting image. 

15. A recording medium in which a program is recorded 
in a computer readable manner, said program mak- 
ing image data, which is transmitted to an image 
receiver device connecting with a communication 
path, subjected to pre-processing, said program 
causing a computer to attain the functions of: 

making master image data subjected to a spec- 
ified series of image processing; and 
generating a control signal for controlling de- 
tails of image processing to be executed by said 
image receiver device based on the specified 
series of image processing. 
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A recording medium in which a program is recorded 
in a computer readable manner, said program con- 
trolling operations of an image receiver device, said 
program causing a computer to attain the functions 
of: 

determining requirement of image processing 
and, when required, specifying a series of im- 
age processing to be executed by said image 
receiver device, in response to a control signal 
mapped to image data received via a commu- 
nication path; and 

making the input image data subjected to the 
specified series of image processing based on 
the determination. 
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